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(57)Abstract: 

PROBLEM TO BE SOLVED: To make it difficult for a user who receives the same 
material to succeed in a collusion attack. 

SOLUTION: In a watermark system, an encoded data processing apparatus is 
provided for creating a watermarked copy of an original material item by introducing 
one code word in a prescribed set to a copy of an original material item, and the set 
of code words are generated by shifting a first code word in the manner of 
circulation. A correlative value of all the code words generated by sh.ft.ng the first 
code word is calculated by using a Fourier transformation correlator to remarkably 
shorten the time required for detecting a code word in the watermarked matenal 



item. The watermark system, is particularly effective for specifying a creation source 
of a pirate edition copy of a video material produced by photographing watermarked 
images while using a camcorder in a movie theater, for example. 
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CLAIMS 



[Claim(s)] 
[Claim 1] 

In the coded data processor which generates the copy to which at least one water 
mark of this original material item was given by introducing one codeword in the 
group of a predetermined codeword into the copy of an original material item, 
The codeword generation machine which generates the codeword which has two or 
more codeword multipliers, 

It has the coding processor which combines the above-mentioned codeword 
multiplier with the above-mentioned material item, 

Two or more codewords in the group of the above-mentioned predetermined 
codeword are the coded data processors containing the 1st codeword which has two 
or more 1 st codeword multipliers, and other at least one codeword which shifted this 
1 st codeword cyclically and was generated. 
[Claim 2] 



The above-mentioned codeword generation machine is a coded data processor 
according to claim 1 characterized by having the pseudo-random number generation 
machine which generates the pseudo-random number for deriving the above- 
mentioned codeword multiplier. 
[Claim 3] 

The above-mentioned pseudo-random number is a coded data processor according 
to claim 1 or 2 characterized by being generated by initializing the above-mentioned 
pseudo-random number generation machine with the seed value which identifies the 
1 st codeword of the above to a proper. 
[Claim 4] 

The above-mentioned codeword generation machine is claim 1 characterized by 
generating the above-mentioned seed value from the sample of the above- 
mentioned material item thru/or a coded data processor given in 3 any 1 terms. 
[Claim 5] 

The above-mentioned coding processor is claim 1 characterized by changing the 
sequence that the above-mentioned codeword multiplier is combined, based on a 
sequence modification code thru/or a coded data processor given in 4 any 1 terms. 
[Claim 6] 

The discrete cosine transform processor which changes the above-mentioned 
material item into a discrete cosine transform field, 

The material item of the above-mentioned discrete cosine transform field It is 
expressed by two or more discrete cosine multipliers. The above-mentioned coding 
processor By adding one of the above-mentioned codeword multiplier and the 
corresponding discrete cosine transform multipliers By -combining the above- 
mentioned codeword multiplier and the above-mentioned material item, and carrying 
out the reverse discrete cosine transform of the image with which the above- 
mentioned codeword was added by this coding processor and by which the discrete 
cosine transform was carried out [ above-mentioned ] A coded data processor 
[ equipped with the reverse discrete cosine transform processor which generates 
the version to which the water mark of the above-mentioned material item was 
given ] according to claim 6 or 7. 
[Claim 7] 

Projection equipment equipped with claim 1 which at least one of an audio signal and 
picture signals is supplied, and introduces a codeword into at least one of this audio 
signal and picture signals before copy processing thru/or a coded data processor 
given in 6 any 1 terms. 
[Claim 8] 

A web server equipped with claim 1 which it is the web server which offers the 
material item downloaded through the Internet, this material item is supplied before 
this material item downloads, and introduces a codeword into this material item 
thru/or a coded data processor given in 6 any 1 terms. 
[Claim 9] 



The 1 st codeword which has two or more predetermined multipliers distributed in 
pseudo-random, From the group of two or more codewords which consisted of other 
at least one codeword which shifted cyclically and was generated, this 1 st codeword 
Were generated by combining each codeword multiplier corresponding to each 
sample of an original material, respectively. In the detection data processor which 
identifies one or more predetermined codewords which exist in the version to which 
the water mark of an original material item was given, 

The decode processor which reproduces a codeword from the material item to 
which the above-mentioned water mark was given, and generates a playback 
codeword, 

It has the detection processor which detects at least one codeword from the 

correlation value exceeding a predetermined threshold of a codeword, 

The correlation value of two or more above-mentioned codewords, 

The Fourier transform value of the above-mentioned playback codeword is 

computed, 

The Fourier transform value of the 1 st codeword of the group of the above- 
mentioned codeword is computed, 

The complex conjugate of either the Fourier transform value of the above- 
mentioned playback codeword and the Fourier transform value of the codeword by 
which generation was carried out [ above-mentioned ] is computed. 
The 1st middle product sample is computed by carrying out the multiplication of 
each Fourier transform sample of the above-mentioned playback codeword, and the 
Fourier transform sample of the 1 st corresponding codeword of the above. 
The detection data processor called for by computing the correlation sample to 
which inverse transformation of the above-mentioned middle product sample is 
carried out, and each expresses one correlation value in the group of the above- 
mentioned codeword. 
[Claim 10] 

The above-mentioned decode processor subtracts the sample to which the version 
of the material item to which the above-mentioned water mark was given 
corresponds from the sample of the above-mentioned original material item. The 
above-mentioned playback codeword is reproduced by subtracting the sample to 
which the version to which the above-mentioned water mark was given corresponds 
from the sample of the above-mentioned original material item. The detection data 
processor according to claim 9 characterized by generating total of a correlation 
value about each of two or more above-mentioned codewords by investigating 
correlation with the above-mentioned playback codeword and this each codeword. 
[Claim 11] 

A detection data processor [ equipped with the registration processor which relates 
the sample of the version to which the water mark of the above-mentioned original 
material item was given with the sample to which the original material item with 
which the above-mentioned codeword multiplier which carries out correspondence 



was combined corresponds ] according to claim 9 or 10. 
[Claim 12] 

The above-mentioned correlation processor is claim 9 characterized by having the 
codeword generation machine which generates the above-mentioned seed value 
from the material item to which the above-mentioned water mark was given thru/or 
a detection data processor given in 1 1 any 1 terms. 
[Claim 13] 

It is introduced into a material item in a discrete cosine transform field, and the 
above-mentioned codeword is the detection data processor concerned, 
When it has the discrete cosine transform processor which changes into a discrete 
cosine transform field the version to which the above-mentioned water mark was 
given, and an original material item and the above-mentioned playback processor 
subtracts the discrete cosine transform multiplier to which the version to which the 
above-mentioned water mark was given corresponds from the discrete cosine 
transform multiplier of the above-mentioned original material item, they are claim 9 
characterized by generating the above-mentioned playback codeword thru/or a 
detection data processor given in 1 2 any 1 terms. 
[Claim 14] 

In the addressee specification system which specifies the addressee of a material 
item, 

Claim 1 which generates the material item to which the water mark was given by 
introducing into a material item the codeword generated from the seed value which 
specifies the above-mentioned addressee as a proper thru/or a coded data 
processor given in 6 any 1 terms, 

An addressee specification system equipped with claim 9 which detects the 
addressee of this material item by predetermined incorrect detection probability by 
detecting the existence of the codeword in the above-mentioned material item 
thru/or a detection data processor given in 13 any 1 terms. 
[Claim 15] 

In the coding approach which generates the copy to which at least one water mark 
of this original material item was given by introducing one codeword in the group of a 
predetermined codeword into the copy of an original material item, 
The step which generates the codeword which has two or more codeword multipliers, 
It has the step which combines the above-mentioned codeword multiplier with the 
above-mentioned material item, 

The step which generates the above-mentioned codeword. 

The step which generates the 1 st codeword which has two or more 1 st codeword 
multipliers, 

The coding approach of having the step which shifts this 1st codeword cyclically and 
generates other at least one codeword. 
[Claim 16] 

In the discernment approach of identifying the group of one or more predetermined 



codewords which exist in the version to which the water mark of an original material 
item was given generated by combining each codeword multiplier corresponding to 
each sample of the copy of an original material, respectively, 

The step which reproduces a codeword from the material item to which the above- 
mentioned water mark was given, and generates a playback codeword, 
It has the step which detects at least one codeword from the correlation value 
exceeding a predetermined threshold of a codeword. 
The correlation value of two or more above-mentioned codewords, 
The Fourier transform value of the above-mentioned playback codeword is 
computed, 

The Fourier transform value of the 1 st codeword of the group of the above- 
mentioned codeword is computed, 

The complex conjugate of either the Fourier transform value of the above- 
mentioned playback codeword and the Fourier transform value of the codeword by 
which generation was carried out [ above-mentioned ] is computed, 
The 1st middle product sample is computed by carrying out the multiplication of 
each Fourier transform sample of the above-mentioned playback codeword, and the 
Fourier transform sample of the 1 st corresponding codeword of the above. 
The discernment approach searched for by computing the correlation sample to 
which inverse transformation of the above-mentioned middle product sample is 
carried out, and each expresses one correlation value in the group of the above- 
mentioned codeword. 
[Claim 1 7] 

The data signal showing the material item to which the codeword was added by 
claim 1 thru/or the coded data processor given in 6 any 1 terms. 
[Claim 18] 

Data medium with which the data signal according to claim 1 7 was recorded. 
[Claim 19] 

The computer program which offers the instruction which can be executed by 
computer which it is loaded [ computer ] to a data processor and operates this data 
processor as claim 1 thru/or a coded data processor given in 6 any 1 terms or claim 
9 thru/or a detection data processor given in 1 3 any 1 terms. 
[Claim 20] 

The computer program which offers the instruction which can be executed by 
computer which it is loaded [ computer ] to a data processor and makes this data 
processor perform an approach according to claim 15 or 16. 
[Claim 21] 

The computer program product equipped with the medium which can be read by 
computer by which the information signal showing a -computer program according to 
claim 19 or 20 is recorded. 
[Claim 22] 

The receiving set which combines with this input signal at least one codeword which 



multiplier with a material item. Two or more codewords in the group of a 
predetermined codeword contain the 1 st codeword which has two or more 1 st 
codeword multipliers, and other at least one codeword which shifted this 1st 
codeword cyclically and was generated. 
[0010] 

This invention aims at offering the realistic water mark system using the -codeword 
which has a multiplier which is indicated by U.S. Pat. No. 5664018, and which was 
distributed at random. In order to realize an effective system actually, the larger 
possible one of the number of codewords discriminable to a proper is good, a 
distribution to consumer appliances, such as video equipment, the projector for 
movie theaters, etc. sake — millions — it is necessary to prepare the group of tens 
of millions of codewords preferably Here, the processing which the group of the 
codeword which consists of 10 million codewords is generated [ processing ], and 
makes each generated codeword and a playback codeword correlate serves as a big 
processing burden, even if it uses a high performance computer — **** with such 
unreal correlation processing — even if few, time amount long like a user senses as 
inconvenience is required. By the example of this invention, correlation over the 
codeword of a lot can be calculated efficiently. By this example, among the groups 
of a codeword, some [ at least ] codewords generate the 1 st codeword, and are 
generated by computing other codewords by shifting this 1st codeword cyclically. 
Thereby, the correlation value of all the codewords in a group is computable using 
Fourier transform correlator. Fourier transform correlator computes the -correlation 
value of a lot by one processing, and mitigates an operation task substantially so 
that it may mention later. 
[0011] 

Moreover, the detection data processor concerning this invention reproduces a 
codeword from the material item to which the water mark was given, and is equipped 
with the decode processor which generates a playback codeword, and the detection 
processor which detects at least one codeword. A codeword is detected based on 
the correlation value computed by making it correlate with each of two or more 
codewords which had the restored codeword generated. That is, a corresponding 
codeword is detected when a correlation value exceeds a predetermined threshold. 
This correlation value computes the Fourier transform value of a playback codeword, 
and computes the Fourier transform value of the 1 st codeword of the group of a 
codeword. The complex conjugate of either the Fourier transform value of a 
playback codeword and the Fourier transform value of the generated codeword is 
computed. The 1 st middle product sample is computed by carrying out the 
multiplication of each Fourier transform sample of a playback codeword, and the 
Fourier transform sample of the 1st corresponding codeword. Inverse transformation 
of the middle product sample is carried out, and it asks by computing the correlation 
sample to which each expresses one correlation value in the group of a -codeword. 
[0012] 



In a suitable example, a coding processor changes the sequence that the above- 
mentioned codeword multiplier is combined, based on a sequence modification code. 
Corresponding to this, a detection data processor computes a -correlation value by 
returning the sequence of the generated codeword multiplier or a playback codeword 
multiplier in a suitable example. Although the probability for a KORUJON attack to 
be successful by shifting the 1st codeword cyclically becomes high, this probability 
can be reduced by changing the sequence of a codeword multiplier. 
[0013] 

The further side face and the further description of this invention are defined in the 

attached claim. 

[0014] 

[Embodiment of the Invention] 

A general view of a water mark system 

Hereafter, the gestalt of operation of this invention is related to protection of a 
video image, and it explains. The number of copies is determined by the number of 
the users who should distribute a video image. The discernment codeword 
(identification code word) for identifying the copy assigned to one of these users is 
added to each copy. 
[0015] 

A video image is one example of the material protected by embedding a digital 
codeword. The material protected by embedding a codeword may be a material 
including a software program, a digital document, music, an audio signal, and what 
other kinds of information other than a video image. 
[0016] 

Drawing 1 is the block diagram showing the concrete configuration of the coded- 
image processor (encoding image processing apparatus) which introduces a 
discernment codeword into the copy of an original image. The original image I is 
supplied from the source and saved at a frame memory 1 . This original image is 
copied as two or more copies to which the water mark was given {reproduce), and 
the discernment codeword of a proper is given to each copy. An original image is 
supplied to the DCT processor 2, and the DCT processor 2 divides an original image 
into the pixel block of 8x8, and performs DCT processing to each pixel block of 8x8. 
Thereby, the DCT processor 2 generates the DCT resolution picture V. 
[0017] 

In the following explanation, the vocabulary a "sample" shall point out the discrete 
sample which constitutes an image (or you may be the material of other classes in 
fact.). A sample may be a brightness sample of the image which can be copied also 
from a pixel. Therefore, vocabulary called a sample and vocabulary called a pixel may 
be exchangeable depending on a situation. 
[0018] 

The DCT image V is supplied to the coding processor (henceforth an encoder) 4. 
The discernment codeword is also supplied to the coding processor 4 from the 



discernment codeword generation machine 8. 
[0019] 

Two or more seed values (seed) are supplied to the discernment codeword 
generation machine 8. Each seed value is used in order to generate one of the 
discernment codewords which correspond, respectively. Each generated 
discernment codeword is embedded to the copy of an original image, and the image 
to which the water mark was given by this is generated. The discernment codeword 
generation machine 8 is equipped with a pseudo-random number generation machine. 
A pseudo-random number generation machine generates the codeword multiplier for 
forming a specific discernment codeword. In a desirable example, a codeword 
multiplier is generated based on normal distribution. In addition, it may replace with 
this and a codeword multiplier may be beforehand defined based on the seed value 
used since a pseudo-random number generation machine is initialized. Therefore, a 
corresponding seed value exists in each discernment codeword, and each seed value 
is memorized by memory 1 2. That Is, in order to generate the discernment codeword 
Xi, the seed value seedi is read from memory 1 2. and the pseudo-random number 
generation machine in the discernment codeword generation machine 8 is initialized 
using this seed value seedi. 
[0020] 

The DCT version of an original image is expressed in the following explanation as V. 
It is here, 

V={vi}={v1. v2. v3, v4 vN} 

It comes out, and it is and vi is the DCT multiplier of an image. In other examples, vi 
is the sampled value of an image and may express the sampled value of the image in 
the sampled value of an image in a space field, or other fields. 
[0021] 

Each discernment codeword Xi consists of codeword multipliers of n pieces as 
follows. 

Xi={xij}= {xi1, xi2, xi3, xi4 xin} 

Several n of a codeword multiplier corresponds to the measurement size of the 
original image V. In addition, the number of multipliers may differ and this number 
may be determined according to specific application. 
[0022] 

And the vector of the codeword multiplier which constitutes the i~th discernment 
codeword Xi is supplied to an encoder 4 through a channel 14. An encoder 4 
generates the image Wi to which the water mark was given by adding the 
discernment codeword Xi to Image V. In fact, as shown in the following formulas, the 
image Wi to which the water mark was given is generated by applying each codeword 
multiplier to each multiplier of an image. 
Wi=V+Xi 

Wi=v1+xi1, v2+xi2, v3+xi3. v4+xi4 vn+xin 

As shown in drawing 1 , the image Wi to which the water mark was given is 



outputted by it from this image processing system, after reverse DCT conversion is 
carried out by the reverse DCT processor 18 which carries out reverse DCT 
conversion of the image generated by the encoder 4. 
[0023] 

Therefore, as shown in drawing 1 , from an encoder 4, the group of the image to 
which the water mark was given is outputted. If data word is made into a maximum 
of 20 bits, one of the 1 0 million discernment codewords can be chosen, and the 
version Wi to which 1 0 million water marks were given can be generated to an 
original image. 
[0024] 

Although the copy Wi to which the water mark of Image I was given is discriminable 
according to an individual with this discernment codeword, in other examples, data 
can be sent within an image by above-mentioned 20 bits. Therefore, 20 bits of 
payloads of 20 bits for sending data within Image V used in order to choose a 
discernment codeword so that it may explain below are offered. 
{0025] 

The coded-image processor which is shown in drawing 1 and which generates the 
image to which the water mark was given is built into various products in various 
different scenarios with which this invention is applied. For example, a coded-image 
processor can be connected to a website or a web server, and the image to which 
the water mark was given can be downloaded. Before downloading the copy of an 
image, the codeword of a proper is introduced into the image to download and the 
codeword of this proper can detect the addressee of the downloaded image behind. 
[0026] 

In other examples of application, a coded-image processor is incorporated as some 
digital projectors {digital cinema projector), and in a movie theater, in case a 
discernment codeword projects a movie, it is added to an image. By this discernment 
codeword, the projector and movie theater which the movie projected can be 
pinpointed. Therefore, the projector and movie theater where the pirate edition copy 
was created can be pinpointed by the discernment codeword contained in the pirate 
edition copy which photoed the image projected from the projector and was obtained. 
On the other hand, the image to which the water mark was given may be copied as a 
photograph or printed matter, and may create and distribute the copy of the copied 
photograph or printed matter. In drawing 1 , the distribution place of the image to 
which the water mark generated by the coded-image processor was given is shown 
by the distribution 1 9 expressed by the cloud-shaped frame. 
[0027] 

Detection processor 

Drawing 2 is the block diagram showing the configuration of the detection image 
processing system (detecting image processing apparatus) which detects one or 
more codewords currently embedded in the OFENDINGU image {offending 
markedimage) to which the water mark was ^iven. Speaking comprehensively, the 



detection image processing system shown in drawing 2 having the function to 
identify one or more codewords which exist in OFENDINGU of an image, i.e., a copy. 
[0028] 

OFENDINGU version W of the image to which the water mark was given is supplied 
from the source of data, and is saved at a frame memory 20. Since the detection 
processing in this detection image processing system needs the original version of 
an image, the original version of an image is saved at the frame memory 24. The 
original version of OFENDINGU version W of the image to which the water mark was 
given, and an image is supplied to the registration processor {registration processor) 
30 through the connection channels 26 and 28 according to individual, respectively. 
[0029] 

As mentioned above, OFENDINGU version W of an image may have been generated 
by photoing or copying some images Wi to which the water mark was given. Then, in 
order to raise the detection ratio of a discernment codeword, the registration 
processor 30 arranges substantially the original version of the OFENDINGU image 
saved at frame memories 20 and 24, respectively, and an image <align). This purpose 
is investigating correspondence relation with the sample of the corresponding image 
Wi with which Sample I and the water mark of an original image are attached, and 
the codeword multiplier's is added. 
[0030] 

This registration processing is explained using drawing 3 . Drawing 3 compares 
OFENDINGU version W of the original image I and the image to which the water 
mark was «iven, and is shown. As shown in drawing 3 , OFENDINGU version W of 
the image to which the water mark was given has offset to the original image, and 
this offset may originate in the relative visual field of a camera that the OFENDINGU 
version of the image to which the water mark was given was -generated. 
{0031] 

In order to reproduce the expression of a codeword multiplier, it is necessary to 
subtract the right sample of an original image from OFENDINGU version W of the 
image to which the water mark was given. Two images are arranged for this 
processing. As shown in drawing 3 , registered image W" has the boundary region 
(peripheral area) PA which contains in an original image the part not existing. 
[0032] 

By other examples, when an OFENDINGU version downloads, for example from the 
Internet, correspondence relation with the version I of an original image may already 
be in **, and, in such a case, it is not necessary to use the registration processor 30 
with OFENDINGU image W. Then, this detection image processing system is 
equipped with the alternative-channel 32 for supplying directly the image to which 
the water mark was given to the playback processor 40. 
[0033] 

Registered image W" is supplied to the playback processor 40. The copy of the 
original image I is also supplied to the playback processor 40 through the 2nd 



channel 44. Image W" and the original image I which were registered are changed 
into a DCT field by the DCT processor 46. Next, as shown in the following formulas, 
presumed codeword X' is computed by subtracting sample V of the DCT field of the 
image to which the water mark was given from the sample V of the DCT field of an 
original image. 
X'=V'-V 

= v'1-v1, v'2-v2, v'3-v3. v'4-v4 v'n-vn 

= x'1, x'2, x'3, x'4 x'n 

Therefore, the playback processor 40 outputs the estimate of the multiplier of the 
codeword which should be identified through the connection channel 50. Reproduced 
codeword X' is supplied to the 1st input terminal of correlator 52. The codeword Xi 
generated with the codeword generation vessel 54 is supplied to the 2nd input 
terminal of correlator 52. The codeword generation machine 54 generates the group 
of all possible codewords using the predetermined seed value which identifies to a 
proper the codeword read from memory 58 like the above-mentioned discernment 
codeword generation machine 8. 
[0034] 

Correlator 52 generates the similar value sim of n pieces (i). In one example, the 
similar value sim (i) is computed by searching for the correlation based on the 
following formulas. 
[0035] 

[Equation 1] 

jg ID=000003 



[0036] 

Each of the similar value sim of n pieces (i) is supplied to a detector 60. and a 
detector 60 analyzes the similar value sim of n possible codewords (i) which is alike, 
respectively and receives. The relation between the example of the similar value sim 
(i) generated by correlator 52 and the threshold TH of each possible codeword is 
shown in drawing 4 . As shown in drawing 4 , two codewords 2001 and 12345 are 
over the threshold TH. For this reason, a detector 60 judges with the OFENDINGU 
image having been created from the version of the image to which the water mark 
corresponding to a codeword 2001 and a codeword 12345 was given. Therefore, in 
this example, the height of the threshold TH which guarantees incorrect detection 
probability can be set up based on the incorrect detection probability (false positive 
probability) determined with the magnitude of the population which is 10 million, and 



water mark reinforcement (watermarking strength). By the example shown in drawing 
4 , when the similar value generated by correlator 52 is over the threshold, it has 
this incorrect detection probability, the addressee of the image to which this water 
mark was given performs a malfeasance, and it is judged that it participated in 
creation of the OFENDINGU version Wi of the image to which the water mark was 
given. 
[0037] 

Hereafter, the water mark system feature and advantage which are shown in drawing 

1 and drawing 2 are explained. 

[0038] 

Registration 

The processing which arranges the OFENDINGU version of the image to which the 
water mark was given, and the copy of an original image includes the processing 
which investigates correlation with the sample of an original image, and the sample 
of the image to which the water mark was given. This correlation processing is 
performed by shifting each sample of an image by different shift amount. This 
processing is explained using drawing 5 . Drawing 5 A shows the discrete sample of 
an original image, and drawing 5 B shows the discrete sample of OFENDINGU image 
W to which the water mark was given. As shown in drawing 5 A and drawing 5 B, the 
time difference between each sample is dt which becomes settled with a sampling 
rate. The group of each sample of these images is shifted and the result of having 
made the discrete sample correlating is shown in drawing 5 C. 
[0039] 

As shown in drawing 5 C, the correlation peak is the highest between the 6th sample 
and the 7th sample. Then, to an original image, only this amount is shifted and the 
OFENDINGU image to which the water mark was given is registered. 
[0040] 

Fourier decode 

The water mark system mentioned above with reference to drawing 1 and drawing 2 
can create the version to which 1 0 million water marks were given to the original 
image. This is realized by using the water mark value of 20 bits. Here, in order to 
detect existence of the codeword in the OFENDINGU image to which the water 
mark was given among two or more codewords as mentioned above, it is necessary 
to investigate correlation with the codeword reproduced from the image, and each 
1 0 million possible codeword. Such an operation task serves as a big processing 
burden. 
[0041] 

The correlator based on this invention shortens time amount required in order to 
detect the codeword in the OFENDINGU image to which the burden of this data 
processing was mitigated, therefore the water mark was given. This correlator based 
on this invention is shown in drawing 6 . The correlator shown in drawing 6 offers 
effective technique on the alternative target to calculation of total of the -correlation 



value mentioned above. That is, by this example, total of a -correlation value is 

computed based on the following formulas. 

F-1[F(X')F(x(1))*] 

Here, F (A) expresses the Fourier transform of A and F-1 (A) expresses the inverse 

Fourier transform of A. 

[0042] 

The correlator 52 shown in drawing 6 is equipped with the 1st Fourier transform 
processor 100 and the 2nd Fourier transform processor 102. The 1st and 2nd 
Fourier transform processors 100 and 102 may be realized using a fast-Fourier- 
transform algorithm. The 2nd Fourier transform processor 1 02 also computes the 
complex conjugate X1 of the Fourier transform value of the generated codeword. 
The complex conjugate X1 of Fourier transform value X' of a playback codeword and 
the Fourier transform of the generated codeword is supplied to the 1st and 2nd 
input terminals of a multiplier 1 10, respectively. A multiplier 1 10 carries out the 
multiplication of each sample from the Fourier transform processors 100 and 102, 
and supplies this result to the inverse Fourier transform processor 1 1 2. From this 
correlator 52, the inverse Fourier transform value of the signal sample by which 
multiplication was carried out is outputted. 
[0043] 

Thus, in the correlator 52 shown in drawing 6 , time amount required in order to 
compute correlation with n codewords Xi and playback codeword X' which were 
generated is shortened. This is because fast-Fourier-transform integrated circuits, 
such as an application-specific integrated circuit (application specific integrated 
circuitASIC) marketed, for example, can constitute the Fourier transform 
processors 100. 102, and 112. Furthermore, the inverse Fourier transform value 
outputted from correlator 52 offers the similar value sim of n pieces corresponding 
to total of the correlation value of n pieces (i). Here, in order to use the property of 
the correlator 52 shown in drawing 6 , the codeword is generated by shifting one 
generated codeword X (1) cyclically using the specific seed value supplied to a 
random-number generation machine. Hereafter, generation of this codeword is 
explained. The 1st codeword X (1) is expressed as values x1-xn corresponding to 
the numeric value generated in pseudo-random with the codeword generation vessel 
8 so that it may mention later. On the other hand, the 2nd codeword X (2) is 
generated by performing the cyclic shift to the 1st codeword X (1). Furthermore, as 
shown below, other codewords are generated by shifting the 1st codeword X (1) 
cyclically until the n~th codeword is shifted to the location of n-1 . 
X(1 )=(x1 ,x2,x3.x4....xn-1 ,xn) 
X(2)=(x2,x3,x4...,xn- 1 ,xn,x 1 ) 
X(3)=(x3,x4....xn-1 ,xn,x1 ,x2) 



X(n)=(xn,x1 ,x2,x3,x4...,xn-2,xn-1 ) 

The correlator 52 which performs the Fourier transform can compute all the similar 



values about all n codewords by one processing by constituting a part or all of a 
group of a codeword that is generated by the coded-image processor using the 
group of this codeword. Therefore, the total sim of the similar value of n pieces <i) is 
generated as mentioned above by the shift to which it corresponds from 1 to an 
original codeword to n, and as shown in drawing 4 , the total sim of a big similar 
value (i) is generated about at least one codeword. Thus, correlator 52 can receive 
only one generated codeword corresponding to the 1st codeword X (1), and as 
shown in drawing 4 , it can compute the similar value about the group of n 
codewords. 
[0044] 

If the sample contained in a codeword like [ it is ****** and ] from the above 
explanation is N individual, a possible circular shift is only N individual. Therefore, if 
the population p of a required codeword is larger than N, the water mark used as 
two or more foundations is needed. The water mark used as each foundation is 
shifted cyclically, and the peculiar codeword of N individual is generated. 
[0045] 

When the image to which the water mark was given constitutes one of two or more 
of the images, such as for example, a video sequence, the same codeword can be 
given to each image. Therefore, if the codeword under one judgment (suspected 
code word) is specified using the Fourier transform correlator shown in drawing 6 , 
even if it uses the total sim of a perfect correlation value (i) as mentioned above, 
the correlation value which follows is computable. What is necessary is here, to 
perform correlation processing only to the codeword specified by the Fourier 
transform correlator shown in drawing 6 , since the codeword under judgment is 
already specified. 
[0046] 

Moreover, the complex conjugate of the Fourier transform value of a playback 
codeword may be computed instead of computing the complex conjugate of the 
Fourier transform value of the 1st generated codeword X1. This processing is 
expressed as the 2nd modification of processing by the Fourier transform correlator 
shown below. 
F-1[F(X>F(x(1))] 

Thus, either the complex conjugate of the Fourier transform value of a playback 
codeword and the Fourier transform value of the generated codeword are computed 
by either of the Fourier transform processors 1 00 and 1 02. 
[0047] 

Secret sequence modification of a codeword 

There is a problem that the security of a water mark falls, by the technique of 
making shift the 1st codeword X1 cyclically, and generating a codeword. This is 
because two images to which the water mark was given are compared in a 
KORUJON attack. When the codeword which are two versions of the same 
codeword which was made to shift the same codeword cyclically and generated it is 



added to each image, those who try a KORUJON attack specify the difference 
between 2 materials to which the water mark was given, therefore it becomes easy 
to specify a codeword. If those who try a KORUJON attack can specify a codeword, 
this person can remove a water mark, or can alter a water mark, and can pretend to 
be the others. 
[0048] 

In order to prevent such a KORUJON attack, by this example, the sequence of each 
codeword multiplier of each codeword shifted cyclically is changed at random based 
on the secret sequence modification code (secret permutation code) pi. A sequence 
change of a codeword multiplier is made secret to the addressee of the image to 
which the water mark was given. It becomes difficult for those who try a KORUJON 
attack to specify by this correlation between two images to which the water mark 
was given, and possibility that a KORUJON attack will be successful falls. 
[0049] 

In a detection data processor, the secret sequence exchange code pi is known. In a 
detection data processor, correlation processing is performed, after performing 
reverse-order exchange pi- to the codeword multiplier or playback codeword 
multiplier which the codeword generation machine or the restoration processor 40 
generated. The actuation of a detection data processor shown in the coding data 
processor and drawing 2 which are shown in drawing 1 is shown in drawing 7 and 
drawing 8 , respectively. 
[0050] 

Codeword generation 

By generating the seed value of the random number used in order to generate a 
codeword from a source image sample, the engine performance of the example of 
this invention shown in drawing 1 and drawing 2 can be raised further. This 
processing analyzes the DOT multiplier of the image which should attach a water 
mark, and is realized by generating the seed value used from these DOT multipliers 
in order to generate a codeword. The "secure hash algorithm 1 (secure hashing 
algorithm 1:sha-1)" of the common knowledge for for example, this contractor can 
be used for this processing. This algorithm is specified to ANSI Standaards (ANSI x 
9.30-2). This algorithm is indicated by A Jay Menezes (A. J.Menezes) work "an 
application cryptography handbook (Handbook of applied cryptography)." Thereby, a 
coded-image processor and a detection image processing system can generate and 
judge the seed value of a random number from a DOT multiplier. 
[0051] 

Other examples of application 

In addition to the projector and web server which were mentioned above, the coded 
data processor of a water mark system is applicable to other applications. For 
example, this invention can receive a signal from a communication device, and can 
apply it also to the receiver/decoder which gives a water mark to information by 
introducing a codeword into this received signal. For example, a set top box receives 



television and a video signal from the "head end" device or multicast device of 
broadcast. In such an example of application, a coded data processor constitutes a 
part of set top box. and in case it receives and decodes a signal, it introduces a 
water mark codeword into a video signal. Setting in one example, this water mark 
codeword specifies the set top box which received and decoded the video signal as 
a proper. 
[0052] 

Furthermore, this invention is applicable also to the digital cinema receiver which 
receives digital cinema data (digital cinema film) from a satellite. This digital cinema 
receiver receives the signal showing a digital cinema, decodes this signal, and 
reproduces a digital cinema. This receiver is equipped with the coded data processor 
which introduces a water mark codeword into the decoded movie signal. A water 
mark codeword specifies the digital cinema receiver which received for example, 
digital cinema data as a proper. 
[0053] 

Furthermore, this invention is applicable to a digital camera or a camcorder equipped 
with memory and a memory controller etc. In this example of application, the coded 
data processor concerning this invention introduces the water mark codeword 
memorized by memory into the video signal photoed with the digital camera etc. In 
this example of application, the codeword is beforehand memorized by memory, 
therefore the coded data processor is not equipped with the codeword generation 
machine. The codeword memorized by memory is embedded under control of a 
memory controller at a video signal, and, thereby, specifies a video signal as a false 
proper target (quasi-uniquely) peculiar. 
[0054] 

In the further example, the coded data processor based on this invention embeds a 
series of water mark codewords according to an individual at each of the frame of 
the digital image from which the plurality which constitutes a continuous image or a 
continuous animation differs. These codewords may have relevance mutually and 
can identify now the image corresponding to each frame according to an individual 
by these codewords. 
[0055] 

The further various side faces and descriptions of this invention are defined in the 
attached claim. The gestalt of operation mentioned above can be changed variously, 
without deviating from this claim. 
[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of a coded-image 
processor. 

[Drawing 2] It is the block diagram showing the configuration of a detection image 
processing system. 

[Drawing 3] Drawing 3 A shows an original image, drawing 3 B shows the image to 
which the water mark was given, and drawing 3 C is drawing showing the registered 



image. 

[Drawing 4] It is the graphical representation showing the example of the correlation 
result about each codeword of the group of the codeword of N individual. 
[Drawing 5] Drawing 5 A is a graphical representation corresponding to the sample 
of the original image I, drawing 5 B is a graphical representation corresponding to 
image W to which the water mark was given, and drawing 5 C is the graphical 
representation showing the correlation result for every discrete sample shift of an 
original image and the image to which the water mark was given. 
[Drawing 6] It is the block diagram showing the configuration of the correlator which 
is a part of detection data processor shown in drawing 2 . 

[Drawing 7] It is the flow chart which shows the procedure which creates the image 
to which the water mark was given by the coded-image data processor. 
[Drawing 8] It is the flow chart which shows the processing which specifies a water 
mark from the image to which the water mark which received was given by the 
detection data processor shown in drawing 2 . 
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[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of a coded-image 
processor. 

[Drawing 2] It is the block diagram showing the configuration of a detection image 
processing system. 

[Drawing 3] Drawing 3 A shows an original image, drawing 3 B shows the image to 
which the water mark was given, and drawing 3 C is drawing showing the registered 
image. 

[Drawing 4] It is the graphical representation showing the example of the correlation 
result about each codeword of the group of the codeword of N individual. 
[Drawing 5] Drawing 5 A is a graphical representation corresponding to the sample 
of the original image I, drawing 5 B is a graphical representation corresponding to 
image W to which the water mark was given, and drawing 5 C is the graphical 
representation showing the correlation result for every discrete sample shift of an 
original image and the image to which the water mark was given. 
[Drawing 6] It is the block diagram showing the configuration of the correlator which 
is a part of detection data processor shown in drawing 2 . 

[Drawing 7] It is the flow chart which shows the procedure which creates the image 

to which the water mark was given by the coded-image data processor. 

[Drawing 8] It is the flow chart which shows the processing which specifies a water 



mark from the image to which the water mark which received was given by the 
detection data processor shown in drawing 2 . 
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W»*ft5.-cni:MIT5XlRTft* 1 9.9 8|7fi 2 7 B, M I TjfcSSefrSnfc. 
J^x-f '*'J7> (J. Ki 1 i a n ) , 17 • f-f - ■ l/-f h> (F. T. Le igh 
t on) m , ra;i,-v3>Ti5'>>^(C^-rs^v f 3';U'i7*-^V-^0«g| (Re s i 
stance of Digital Watermarks to Collusio 
n At t acks) J \t , 7*y££|£<;t*(D;i®£*-^V-*>y$!lg(£f¥jjS 

[ 0 0 0 9 ] 

'J 7 )V7 ^ *r I* <D 'p 1Si < £ lO(D?*-*v-?#tt;*n*:r3fcr-££j&-r&. 3 — h* 
9 - h* « . |RC3-I«9-F*|[fttt5. fffftr-i'filSltt. n - -7 - h* & 

ftflHSOn-^-ni, JBl©«ft03-H7-h , *ft*tt*JBlfiD3-H7-f 
t , u©^ l ©3 - K7 - K$SSWl:y7 M,T4fiKSnfc'>ft<i'b l ^©ffiOD- 
K u - H <h * tr . 
[0010] 

* fS W , *l^ffl 5 6 6 4 0 1 8 ^l:li$ni^5cl;pfi 1 7 > ^ A K # L Gfc 
& £ W "T 3 - h*7- HS*JfflLfcSJi«a7*-^7-i»">7TA*«*t4I-t*l 
Wit5. ^HWt3W^^->7.^A^Sl31-rs/ti*(zS, Sti:^giJ-Ct5 3- K7 - H 

5. C CT, -f^l03-K7-H^5&53-K7-H©a$4sjtL. 4**nfc§ 
3-F7-l«tS43-K7-Kt6«Ha*5 14 , * €T ft & 3 H £ <h fc -5 . iff 14 HE 
3>trj.-*£ffl^T&, ^OiiftttHffllli, * fi H «J ft X \t '> & < £ 3. - if a* * 

m <d m.n & %) m &j \z n -d z t & g z> . z<Dm&m-c\z. □ - k 7 — f « *& © 5 , ^ & 

— ggcDZJ-H^-Ktt, Hcn-^-HitlJL, 1 5)3 - F'7 - 

|<i«)4TC3-H9-F0«Bitt, 7-UX*«ffiH»£ffitr»Tj|tttiT*S. IStS 
±7l:, 7-Ux«*ffiHI»tt, -»©«Htt*llHl©8iST*HJU, &H*7.*£3IJt 

[0011] 

£ , *&w\z&zmthy : - * n&wmmte. tt a nit-* r v 7 >v 7 <r 

A*e3-F7-FSS4L. St3-F7-KS45)ct5Sf 7at-yiti, >J> 13. < £ 
i±ib, 3-F7-Fff)I©Slffl3-K7-K07-Ul|!ftI5ItliL 1 B £ 3 - K 7 

- h , o7-'ji3?»tstf4)«^nfc3 - h* 7- K©7-ux^m<i©vi-rn^-7j©^ 

2M£ £ » ffi L , S^n-K'7-Kc75&7-'Jx^^-tf>^ , ;i, < h^^-rs^l©n--K'7 
-K®7-'Ji3!E«-!r>7 , ^t*SIl/T»l ©1'P B 1fi1r>7*Jl'*IffiL, + 

£ i£ ^ & L . n tl *« n - K -7 - HOIC5 1 ^)©«Mfii&^-rffiii-!t>^ > ;p * 

[0012] 
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m^-^^S^BtS, * fig <* tt 3 - F 7 - F # « X B f? £ =1 - F "7 - F % Sfe © HI jf* g| 
LTffillB{I©iEffi£fT5. i 1 ©3 - H9 - ^«IWlCy7 ht 5 : iC J; D 3 JHy 

[0013] 

**9!©MfcS«iiiRtf«r«tt, *#®»*<5«Bl:*tJTt*snTi>5. 
[0014] 

•7*-*V-27 5/*t-A©H[« 

lA»CW?J^T6tifcatf-fettJB'J'r*fc*©lt9j3-H , 7-H (ident i f i c a 
tion code wo r d) ^^lisn?!. 
[0015] 

trtmii, 5? ^ ;W n - F -7 - K Si»atf : t I: J: 0 ««S n*7r 'J H 

3-F r 7-KSrai*)itf^it;j;f9«ai$n-5-7^uy;na. e 7 s hi & © 

lfi©f*S^tf7r'J7^T»oT 1 bJ:^. .20 
[0016] 

H 1 tt . ^ 1 J> ! ±;Hll«©=ihf-t^SiJ=i-K7-F&^A-r«>?3 : ^fc®^^31g« <e 
ncoding image processing apparatus) Ql^^i 
tit*?*-?? a y 2 $> Z> . t'JytMtlH, V-^36»6«|&Sn, 7 1/-A>t>J 

^ 2 *l £ (reproduce)'fe©T&9, 3 t! — fc ta , @ W © ^6 S'J n — H 7 — F 

a* # £ n 5 „ *'jj;t;mitt, d c t :/ o -t -.y 2 & *s 3 n . DCT^n-fey-y-sii 

, ;*Ui^;i/®&£8X8©li3?i:7*D*.y:>M;:#ti.]b. 8X 8 CD #1$ ^ D y ^ {; D C T M 

5 * tt "T . Cint'cfcO, DCT7"ntyt2li. D C T f lit V * 4^cf 5. 
[0017] 30 

«T©K9H::45^T, r U- > ^ j tu5fflBIJ. H « ( X . ^KfcttttOM©-?-^ 

6 s t $ ^ r & c: t # t ^ s a ft © w > ■? >v t * ^ t *> «k ^ . Lt^ot, -t*- > :/ >u 

[0018] 

DCTItVtt, nmtZfWty*)- («T, X>3-^.fcfc^5. ) 4 Cfti^^ni.. «F 

tjfc7*ntyt4l:«, Mtgij n - F -7 - F 8 6 tt&J n - F -7 - F fc #*S 3 *IT u 

5 o 

[0019] 

«H3-H7-FtriE»8l:l4, « ft © -> - F tt ( s e e d ) ft IS 3 tl -5 . # -> - F ft 40 

£■ 88 S'J 3 — F 9 — KB, t'JytJUiCDnt-lilftiXjn. ;ni:<);r)7*-^7- 

^a»ftsnfci«^4i«sn5. n 9J n - h «7 - f £ & s 8 a , %<m&ft&ft8g.&tt*.s 
o myaft£fi£3§«. utroaisyn- h'7-^i^i-4fcJ6©a-f*7-FiS(j4)$ 

. fc 4s , Z. tl IZ ft X T , 3-F7-Fffil$H, »ffiia» fcWMftt 5 & ft Cffl t> 6 

5 -> - F <g rt* ft & L , & — F ffl 12 , ;* ^ 'J l 2CE*SfttH5. -T U t> , SS gij n — 
StStifcftC ->-FMseed,^^ ; E'J12A^e,^*J±iL, d <D -> 
-Fffls e e d , SfflUT, M »J 3 - F 7 - F £fc l« » 8 ft © » (H a* £ # » & *J »! -ft T * 50 
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[ 0 0 2 0 ] 

T © Ift BJ1 T tf , t'Jyt;HiCDCTy\ , -y 3 >$Vtlt. Z\ Z\ X' , 

V = { v , } = { v i , v 2 . v 3 , v 4 , • • • , v N } 

v, tf , Hjfc©DCT&&T&<5<, ffi © ft # 0!l *5 V» T « . v , , ill £t © +r > 

[ 0 0 2 1 ] 

& §£ gij 3 - K »7 - H X 1 tt , «TO«t5C, nfi©3-F7-KffRi»6I««nTtJ5 

X l = {x' j ) = (x 1 1 , x ' 2 > x 1 3 . x' 4> • • • , x' n } 
n-F9-F«*©ftntt, t 'J y t JH«V Wt>^JH!cl:M«t 5. fc *s , **©* 
liS^^fe©T*oTfeJ:< . £ © & tf , Wg«)7^'jy-->3>l:*i;Tft«UfeJ: 
n . 
[ 0 0 2 2 ] 

tl/T, i # @ © SB S>J □ - F 9 - F X 1 Si«f53-F7-H«tC^j'h , * 
>^iH4^jHTI>3-y4l;ft^Sn5 0 X > D - y 4 12 , Bitt V K H g»J D — F .7 

- FX 1 S#at5:ti:,k!3, ->*-^Y-^^#snfcl«w, .^tflcts. lit: 

^-^^-^^f^snfciaffcw, a* £ j& ;* n 5 0 
w , = v + x 1 

W , = v x + x 1 i , v 2 + x ! 2 > Vg+x'a, v 4 + x 1 4 , • • • , v n 4- x ' 

0 1 t:Stct5l:, O * - 5> - ? ft i* ti tz W i tf , x>3-y4fz«fcD£0££*i 
ftII«lDCT|i1-4»DCTynty*l8i:i9T, 2»DCT*lfc£nfc«. - 

[ 0 0 2 3 ] 

L *)< o T , HItiTiil:. I>3-^4^5tt, 7 * - * V - * a«# S *l fc H * © 

& a< m ^ $ n 5 . f-^7-h'5i^2 0^7 Fttst, -^©©sasuri-F^-F 
fflnsiffitsct^tt, jj-Ui>tJH*i:»l/T, -=F7j{@©<7*-*v-£attt 

[ 0 0 2 4 ] 

SHt4:i*TS*««, AS © ft # « *5 U T tt , ± » © 2 0 tf *j h fc «t 0 , Ei & F*3 T ^ - 
*fti£5Cl<h#T*#£. Lfc^oT, &Tl:ttflf & SU n - F "7 - F ft £ K T 

Sft»l:*lSn52 0 tf y h tf , ®#VrtT'x-5'ftiilSfeJ6©2 OH'; h©^<D- 
F ft ft ft T « . 
[ 0 0 2 5 ] 

affl*n*«*ft*ft*s/^-u*fc*v»T. i^/ctsaica^asn?.. 0<j *. tf . n it 
wmmmmm ft •> x y hxi^x^^-ActisLT, ^*-^7-d?!jt#sn-fci 
i$y^>D-Fi-5:ti5«-ef 5. iS«©3tf-ft^9>o-K-r*i«rtc, ^ 9 > a - 
K$n5Hittt@t©3- F7 - F*i®A$n, i ©@ t w 3 - k 7 - h* t: i o . ^ >7 
> a - K**ifciiHfc©S«#ft«^*Hi-rsc:t3&«T?#*. 

[ 0 0 2 6 ] 

te©ilffl0»J-etf, ft^fcBifftfilg&etf, 5 s y ^ ^ * 9 « ( d i g i t a l c i nem 
a proj ec tor) ©-eBtLT&^&^n, HS'J 3 - F 7 - F li, 0»J *. tf I* M 
K&^T, BfcHiftBfc^TSI&fc:, efc&KtfinSns. z: © f§S S'J 3 — F 7 - F {: i 0 . 
3&*BH^SnfclS*^«&^l*liI«Bft»«-r*i:t**-C**. Lfci^T, 
nfc«*6»«UTft6*ifciSIK)Rai;-l:^Sft5I8iJa- F "7 — FCiri, ^ © ig US 
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*« 3 *l IS ft , ^XXttEP8iJ*)<i:LT«^SnTfc«fc<, ttfsnfcf te-EPWJ « 
[ 0 0 2 7 ] 

tu y d -fe -y- 

8 2IJ. r>*-^V-^*«ftanfc^-7x>7 :: >C>^'Hi^ (o f fend i n g ma r 
ked image) ftKiftasnt^S 1 oaion- H7 - H £*ft-HJ f -5 tt'UHtt A 
Sigfil (detecting image processing apparatus 10 
) Oi)«6ftyPyi'H"?*5. a JB fiSl lw A tf , 02(c^t-^tii® ft & ililJ, ® 

iwt7x>r>f > *r , -r & t> □ e-rtc$fit5 i o^±<^3 - K7 - h * ■ ai r * 

[ 0 0 2 8 ] 

£ * - * V - £ flt ft £ I!*:® ft O * 7 x > 7 s -f > y A* - S> 3 > W ' H , ^-^Sfr&flfclft 

an. 7U-A^*u2ot«#ans. £®ttWHftfflaKsi;:£t?s4feffi4!i3i;j:. m 

t«D* 'Jyt^^-va >S*f ftSfc*. 7U-A^tU 2 4l:tt, Si ft © * 'J 5> :j- 

s> a > w stfiicD*u j ;t^yt-*;3>tt, * n <r n m so © & m r * > * ^ 2 6 , .2 

8*^l/T, Ig^Dt';t (registration processor) 30 IZ 20 
[ 0 0 2 9 ] 





<k 








ftw , 


CO 






f tt su n - 


K 9 - 


h* 


cD^ffi^&S!i46-5^:i6(3, Ott. ^ ft ? ft 




U — A ^ i U 5 fl 


. 2 4 


(3 


&w 2 ftx z * 7 * > 7 4 >^tsfti:®ft©^-'j v ^- ;i/ a 




v a > £ * m s w 


(c $i 


5 


(al ign) o £ © g Mte > :* U i> ;U Bi ft © If > :/ ;P I 




, ^ * - * * 


**tta 


n 


. =i-H , 7-r s «»c36«#joanT^5*r«'r«Hftw 1 ©-y- 


> 




£ P t 


s 








[ 0 0 


3 


0 ] 







:<0Slj6iSB3*ffll>TR»t5. H 3 tt . t U y t I i 9 * - ^ V - i7 A«# 

anfe®ft0^-7x>7 ^ >r>v'A->'3>W , i&ttKLTSLTl^. ® 3 K ^ T <fc "5 

n , i 7^-^v-^*i^anfeHftco*>'x>7 ; 'C>^A — ^ 3 >w * v i> ± )\,m 

o^-^x>7 s ^ > ^ a - ->* 3 >Ai4eK$nt*^7fflffi«M^isi;eats pj m 
%> . 

[ 0 0 3 1 ] 

n - K7 - K^IScD^^^fl^-r^^felC "7*-^v-^*i#$n^li)ftcD^7x>^ 
>^a-:x3 > w ^€>^-u> ? y-;naftcDiELi>-y->^;i/SrM*-r^) &-£ ** tb -5 . n © 
m m © ft tt> \z , 2-3©aft*t»A6n*. 0 3 ic ^ -r £ 5 \z , ig^tifc hi ft w " « , ■* 40 

'J T )V m ft fc « GF £ L ft ^ SB # £ ^ tS m m m m. ( P e r i phe r a 1 a r e a) P 
[ 0 0 3 2 ] 

f& © Hr # #J T 14 , #1 A 14 > - * y h^e.^7x>^^ > *t ? *y > a - K 

snfci^f , ^-7x>x-r>^®ftw <t n tc: ^- «j y- )v m ft © a - -j 3 > i £ © ^ 

H « ** W T & 5 d <h # £ 0 . iI©ct5^«-&, lg^Dt7t3 0$ffflt5i;>IliS 

4 0 £i68&«*&-r*fc«>fl!>tt#Wfc?'* >^;U3 2 StMATIsS. 
[ 0 0 3 3 ] 
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2cf t>*;M4«^iT, t'jyt^iti ©3K-fe«i&5n*. sg^ti&i« 
w " Rtft u s j-y )\r mm i a , d c t y □ -t it 4 6 \~ «k -o t . d c t mm\zm&$ n% 

o Xiz. ^TcSCStJ;^:. tUyt;Hi©DCTi80it>yjl.v^6'>*-^ 
V - ^ *t # £ n fc H fife © D C T mt$, © D- > Zf )VV ' *«It5:t{:±D, m £ U - H 9 
-FX' j&«*ttJ S *l*> . 
X 1 = V * - V 

= V ' 1 ~ v 1 - v ' 2~ v 2. v ' 3 _v 3. V ' 4 - V 4 , • • • , V ' n — V „ 
= X j,X 3,X 4 , • * • , X n 

L # ^ T , Bt^nf;t4 0tt, 8«f t>*Jl^5 OS^LT, ft gij T ^ # □ - K «7 
-K©#&©if5£fit£lij£-r-5o BtSftft3-K7-HX' , ffii^5 2©$10A 10 

TtiE3nfc3-F7-h , X l 4««8Sft.TH«. 3 - H7 - F4UB5 411, ± i£ © 1& 
gij n - h* <7 - h* £ g§ 8 £ H m. IZ , ^t'J 5 8^f.l*(liLfc3 - H 7 - h' 5: S t l: S &J 
T£f^£©5>-Kfit£fli^T£T©nJfi£&r] — K U — F O & & ± f& -? 2> a 
[ 0 0 3 4 ] 

ffiHS5 2li, n <S O igf <Ki fit s im (i) £ £ f£ T 5 o -ftftHlC^HTIi, gi fit s i 
[ 0 0 3 5 ] 

[» 1 ] 



n momum s im <i) ©-^n^na, &ajg§6 0{c&)i&£n.g>. ^-^t, &aig§6 o 

. niCnJlftn-^-HCfn-fnCMt^jllls im (i) £ # #r £ . 

2 CioTtliE^tl^iils im (i) © ft # « £ . T»MJg & g- 3 - H «7 - H © « fit 
THt«)g|^S:04{C^-r»EI4tc:^-r«t5(C, 2003— K«7 — t«2 0 0 1, 1 2 34 30 
5^HlTH*gx.TU5. Z<Dfz#>. & & §§ 6 0 tt . 3-H7-K 2 0 0 Utfn - K 
7-h* 1 2 34 5f;^^TS9*-^V-^75tfj-$tl/cili^CDy\*-^3>^6^->'i>5 i 

*>^BHfta*fefifc3ttfc£*ijje-rs. l fc # ^ t , z © ft # m \z a n t \t , - =p 7j & s 

#£!H©*#£iCck9&5££ft-5^&tBfll3s (fa 1 se pos i t ive prob 
abi 1 i ty) £ , (watermarking s trengt 

h) i HI^^T, «tftffi**£«ET*HfflTH©?«S.£KjgT*££a*T.£*. ^4 
lw ^ T ft # 0S T tt . *B l§ i§ 5 2l;J;^T4fi!c$nfc«(!ai!55Kl$SATU5ll^, Zl © 

$ *l £ . 40 
[ 0 0 3 7 ] 

[ 0 0 3 8 ] 

-)*-^7-i7iifff$nfciio*7i>T^ >trn*-*jB > •* u ^ i- )vm fife © n tr 
-<tS:«5>i-5>M3ia, * u V s ±;uis# © it > y )v <t , £ * — 9 v — ? n na fife <z> u- 
>y^toffli$is^5jaii^^tj. n © « h «i s « , mm<D > 7 mtz z> -> ? h 

JUfc^L. (21 5 B fi . ^*-^v-^AJ#$tlfc^-^3i>7 J ^>yjli^ 
W ' (DffiM-*)- > -? )V & SLT^ -5 . i 5 ASl^S 5 B I: i "f i 5 I: . & U" > y ;P M © B3-IH1 50 



jrt*X , i4«^*X , 2+X < 3*x'3+...+jri,*X , w 



sim(i)= 





[ 0 0 3 6 ] 
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[ 0 0 3 9 ] 

05 c tit i 5 i:, m 6 v >?)\, tm 7 v )i<Dr$T'tem¥- ? &mm\ztz-3 -z \,*z> 

[ 0 0 4 0 ] 

Ell&tfia2£#!lLT±$Lfc7:*-*^-^^X^AW:, *U ^t;H«C#tt- 

. =F^"ia«)^*-^v-^^#$nfc/t-'>*3>*f^RK-rsc:t75<i?#-5. cma. 2otf 10 

OSfiE*«ffit4fc»i:lJ.-tOI«*»6S4$nfc3-F7-Kt, - =P 7T f@ © pj il & 

6 n - K 7 - HtofflBSilii^gjjJji. £©<k5ft^#**^te;*:#&$!iJl&fi<Ji 

[ 0 0 4 1 ] 

*58wta-^<fflBBiBtt. z (d mm mm <d turn* mm i, , Lfc^^-)*-^-^^ 

$tlfct7i>r^ >yiil^03 - h* 7 - KSljlliltiftftt^ift^llllSfiBti.. 
*«!Bl:!^<:c«R»fiB6l:St. B6CStffi«JIU. ±i£L&ffi«ft©ttfc© 

F ~ 1 [F(X')F(x <1) )*] 

Z Z. T , F (A) liAC7-'J lI^SgL, F ~ 1 (A) (i A O f 7 - U I f i & g t 
[ 0 0 4 2 ] 

0 6 CStffiiS 5 2 tt, SlCD7-'JxS!ft7*ntytl 0 Oi. jB2CD7-'Jl«» 
^ P -fe y U- 1 0 2 <!: £ <f 5 „ SlSr/i207-'JHS7'Dt^l 0 0, 1 0 2 

, ai7-'JiS!«7J^'JX^Sffli>TSISLTt)J:l>. I 2 © 7 - U S7d t 7 
it 1 0 2 tt , 4)S3tlfe3-F7-F07-'Jllii©Si*SX 1 I? ffi iT 5 o » £ 
3-K7-H07-Ul*««[X' £ , t«Snfc3-K7-KC7-'JIfiOH* 30 

& x 1 , ^ n ^ n sn s§ 1 1 o©^is^i2©A*Sf * * » 1 1 o 
«. 7-uxfi7nt7t 1 00, 1 0 2*^©^^>7 , ;i'*igL. z <d&m 
-'JiSEli7"Di:7f 1 1 2i:ft«t5. :©«MS5 2*^IJ, mw^nfeft#iJ->^ 

[ 0 0 4 3 ] 

£ © «fc 5 , 06l:StfflKS5 2Tli, SsKSn&nfloa-h^-KX 1 
H7-FX' tc7)ffl||Srg[tt}'r?>fefe(3^S^B#^35i@lBI$ns. ^ n « , 7 - »J x se » 
7"ot7tl 0 0, 1 0 2, 1 1 2SM^.Hf|R$nTU2i 1# j£ ffl & IrJ it £1 i'0 S§ ( a p 
plication specific integrated circuit : A S 

1 C) *®»»7-'JXgifcjft*®ttfc±D*j£T#*fcaT*3. Mt3, ffiR|52» 40 
^tB7J^nsiS»7-'Jx^^ffltS, n1H©ffi||ffic7)j^fnJc:»^-rSn<@©ISig(Ms im ( 

i) SrSiftTSo £ £ T , H6l:St«MS5 2C»ttSifiJIt5t«H:. P - H 7 - K 

(1) &SIWl:y7 ht5:,!:l:ctt)46!iSftTU5. :«03 - H7 - HO*)* 

t7l>TR«t5. « SB f * «fc 3 , 8l03-H7-HX ,n tt . n - K 7 - K £ fig 

-77, m2©P-K'7-r ; X <2) (4 , 8KD3-P7-KX' 11 l:«tS«IWy7 
h*^fft5^<!:i:J;ip4fi£Sn5. IK, KTCSTi^l:, Z©ffi©P-r ; 7-K« 
, nil©3-h'7-Ki«n- 1 Offitl:->7 JSl©P— K7— t*X (1 
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X =(x 1 ,x 2 ,x 3 ,x 4 ...,x n _ 1 ,x n ) 
X <2) =(x 2 . x 3 , x 4 . . . , x n _ lf x n , x : ) 

X <3) = ( X 3 , X 4 . . . , X n _ i , X n , X ! , X 2 ) 

X <n> = (X n , X x , X 2 . X 3 , X 4 . . . , X n _ 2 . X n _ 1 ) 

:«)3-)«7-HflaSffll>T. ff§ftI*^Dt7t(:ioT±fi!c$n5 3- H7 - H 

T , _h idi © ; «fc -5 Id , tU^t^n-F7-H tt T -5 l*^nSt«j^^f 5->7 hl:i 
0. nl©Sffil©llP s im (i) ri<£fi!t£n, El 4 I' ^ f £ "5 . 4> & < <h t> 1 ~D <D 
3 - h* "7 - PC "3 H T , *tftiil©gfils im (i) >5< £ fi£ 2 tt £ „ ^ © i ^ C , ffi 
H 83 5 2 12 . il©3-F7-FX (I) \Ztt&? Z> 1 -DVZitiLS tlfrn- \* V - F <Dfr 
£ £ It Sit t> T . S4C^-r«J:-5{Cnffl0D-H'7-H©iiflt-BI|-rs«(Hffl^^ffi-rsci 

[ 0 0 4 4 ] 
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1 Title of Invention 

DATA PROCESSING APPARATUS AND METHOD 

2 Claims 

1. An encoding data processing apparatus for generating at least one 
marked copy of an original item of material by introducing one of a predetermined set 
of code words into a copy of said material item, said apparatus comprising 

a code word generator operable to provide said code word comprising a 
plurality of code word coefficients, and 

an encoding processor operable to combine the code word coefficients with 
said material item, wherein 

said plurality of code words of said set includes a first code word having a first 
plurality of code word coefficients, and at least one other code word generated from a 
cyclic shift of said first code word. 

2. An encoding data processing apparatus as claimed in Claim 1, wherein 
said code word generator includes a pseudo-random number generator operable to 
generate a pseudo-random numbers from which said code word coefficients are 
derived. 

3. An encoding data processing apparatus as claimed in Claims 1 or 2, 
wherein said pseudo-random numbers are generated from a seed value for initialising 
said pseudo-random number generator, which uniquely defines said first code word. 

4. An encoding data processing apparatus as claimed in any preceding 
Claim, wherein said code word generator is operable to generate said seed value from 
the samples of said material item. 

5. An encoding processor as claimed in any preceding Claim, wherein said 
encoding processor is operable to permute the order in which said code word 
coefficients are combined with the material in accordance with a permutation code. 

6. An encoding data processing apparatus as claimed in any preceding 
Claim, comprising 
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a discrete cosine transform processor operable to transform said material item 
into the discrete cosine transform domain, said material item in said discrete cosine 
transform domain being represented as a plurality of discrete cosine transform 
coefficients, wherein said encoding processor is operable to combine said code word 
with said material item by adding each of said code word coefficients to a 
corresponding one of said discrete cosine transform coefficients, and 

an inverse discrete cosine transform processor operable to form said marked 
copy of said material item by performing an inverse discrete cosine transform on said 
discrete cosine transformed image to which said code word has been added by said 
encoding processor. 

7. A cinema projector including an encoding data processing apparatus 
according to any of Claims 1 to 6, wherein said data processing apparatus is operable 
to receive at least one of audio signals and image signals before reproduction, and to 
introduce a code word into said at least one of audio signals and image signals before 
reproduction. 

8. A web server operable to provide material items for downloading via 
the Internet, said web server including an encoding data processing apparatus 
according to any of Claims 1 to 6, wherein said data processing apparatus is operable 
to receive material items and to introduce a code word into said material items before 
said material items are downloaded. 

9. A detecting data processing apparatus operable to identify at least one 
of a plurality of code words present in a marked version of a material item, said 
marked version having been formed by combining each of a plurality of samples of an 
original version of said material with one of a corresponding plurality of code word 
coefficients, said plurality of code words being formed from a first code word having a 
plurality of predetermined pseudo-randomly distributed coefficients and by forming at 
least one other of said plurality of code words by cyclically shifting said first code 
word, said apparatus comprising 
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a decoding processor operable to generate a recovered code word from said 
marked material item, and 

a detection processor operable to detect said at least one code word from the 
correlation value for the code word exceeding a predetermined threshold, wherein said 
correlation value is formed for a plurality of said code words by 

forming a Fourier transform of the recovered code word, 

forming a Fourier transform of the first code word of said set, 

forming the complex conjugate of one of the Fourier transform of the 
recovered code word and the Fourier transform of the regenerated code word, 

forming intermediate product samples by multiplying each of said Fourier 
transform samples of said recovered code word and the corresponding Fourier 
transform samples of said first code word, 

forming correlation samples by forming an inverse transform of said 
intermediate product samples, each of said correlation value samples providing the 
correlation value for one of said set of code words. 

10. A detecting data processing apparatus as claimed in Claim 9, wherein 
said decoding processor is operable to generate said recovered code word by 
subtracting corresponding samples of said original material version from said samples 
of said marked material version, and to generate, for each of said plurality of code 
words a correlation sum by correlating the recovered code word with each of the 
plurality of code words. 

11. A detecting data processing apparatus as claimed in Claim 9 or 10, 
comprising 

a registering processor operable to associate samples of said marked version of 
said material item with corresponding samples from said original material item to 
which corresponding code word coefficients may have been added. 

12. A detecting data processing apparatus as claimed in Claim 9, 10 or 11, 
wherein said correlation processor includes a code word generator operable to generate 
said seed value from the samples of said marked material item. 
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13. A detecting data processing apparatus as claimed in any of Claims 9 to 
12, wherein said code word has been introduced into said material item in the discrete 
cosine transform domain, said apparatus comprising 

a discrete cosine transform processor operable to transform said marked 
material item and said original material item into the discrete cosine transform domain, 
wherein said recovery processor is operable to generate said recovered code word by 
subtracting corresponding discrete cosine transform coefficients of said original 
material version from discrete cosine transform coefficients of said marked material 
version. 

14. A system for identifying the recipient of a material item, said system 
comprising 

an encoding data processor according to any of Claims 1 to 6, operable to 
generate said marked material item by introducing a code word generated from a seed 
uniquely identifying said recipient, and 

a detecting data processor according to any of Claims 9 to 13, operable to 
detect with a predetermined false positive probability the recipient by detecting the 
presence or absence of the code word in said material. 

15. A method of generating at least one marked version of an original item 
of material by introducing one of a predetermined set of code words into a copy of said 
original material item, said method comprising, 

providing said code word with a plurality of code word coefficients, and 
combining the code word coefficients with said material, wherein said 

providing said code word comprises 

generating a first code word having a plurality of coefficients, and 

generating at least one other of said plurality of code words from a cyclic shift 

of said first code word. 

16. A method of identifying one or more of a predetermined set of code 
words present in a marked version of an original material item, said marked version 
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having been formed by combining each of a plurality of samples of a copy of said 
original material item with one of a corresponding plurality of code word coefficients, 
said method comprising 

generating a recovered code word from said marked material item, and 
detecting said at least one code word from the correlation value of the 
recovered code word with a regenerated code word exceeding a predetermined 
threshold, wherein said correlation value is formed for a plurality of said code words 
by 

forming a Fourier transform of the recovered code word, 

forming a Fourier transform of the first code word of said set, 

forming the complex conjugate of one of the Fourier transform of the 

recovered code word and the Fourier transform of the regenerated code word, 

forming intermediate product samples by multiplying each of said Fourier 

transform samples of said recovered code word and the corresponding Fourier 

transform samples of said first code word, 

forming correlation samples by forming an inverse transform of said 

intermediate product samples, each of said correlation value samples providing the 

correlation value for one of said set of code words. 

1 7. A data signal representing a material item to which a code word has 
been added by the data processing apparatus according to any of Claims 1 to 6. 

1 8. A data carrier having recorded thereon a data signal according to Claim 

17. 

19. A computer program providing computer executable instructions, 
which when loaded onto a data processor configures the data processor to operate as 
the encoding data processing apparatus according to any of Claims 1 to 6 or the 
delecting data processor according to any of Claims 9 to 13. 

20. A computer program providing computer executable instructions, 
which when loaded on to a data processor causes the data processor to perform the 
method according to Claim 15 or 16. 
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21. A computer program product having a computer readable medium 
having recorded thereon information signals representative of the computer program 
claimed in any of Claims 19 or 20. 

22. A receiver operable to receive signals representative of material items, 
comprising 

an encoding data processing apparatus according to Claims 1 to 6, operable to 
combine at least one code word with the received signals, said code word being 
provided to identify uniquely said received signals. 

23. A detecting or an encoding data processing apparatus as herein before 
described with reference to the accompanying drawings. 

24. A method of identifying at least one of a predetermined set of code 
words or a method of generating at least one marked copy of an original item of 
material as herein before described with reference to the accompanying drawings. 
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3 Detailed Description of Invention 
Field of Invention 

The present invention relates to encoding data processing apparatus and 
methods, which are arranged to embed code words into versions of material items. In 
some applications the code words are used to uniquely identify the material items. 

Correspondingly, the present invention also relates to data processing apparatus 
and methods operable to detect one or more code words, which may be present in a 
material item. 

Background of the Invention 

A process in which information is embedded in material for the purpose of 
identifying the material is referred to as watermarking. 

Identification code words are applied to versions of material items for the 
purpose of identifying the version of the material item. Watermarking can provide, 
therefore, a facility for identifying a recipient of a particular version of the material. 
As such, if the material is copied or used in a way which is inconsistent with the 
wishes of the distributor of the material, the distributor can identify the material 
version from the identification code word and take appropriate action. 

In this description, an item of material, which is copied or used in a way, which 
is inconsistent with the wishes of the originator, owner, creator or distributor of the 
material, will be referred to for convenience as an offending item of material or 
offending material. 

The material could be any of video, audio, audio/video material, software 
programs, digital documents or any type of information bearing material. 

For a watermarking scheme to be successful, it should be as difficult as 
possible for the users to collude in order to mask or remove the identification code 
words. It should also be as difficult as possible for users to collude to alter the 
identification code word to the effect that one of the other users is falsely indicated as 
the perpetrator of an offending item of material. Such an attempt by users to collude to 
either mask the code word or alter the code word to indicate another user is known as a 
collusion attack. 
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Any watermarking scheme should be arranged to make it difficult for users 
receiving copies of the same material to launch a successful collusion attack. A 
watermarking scheme should therefore with high probability identify a marked 
material item, which has been the subject of a collusion attack. This is achieved by 
identifying a code word recovered from the offending material. Conversely, there 
should be a low probability of not detecting a code word when a code word is present 
(false negative probability). In addition the probability of falsely detecting a user as 
guilty of taking part in a collusion attack, when this user has not taken part, should be 
as low as possible (false positive probability). 

US Patent Serial No. 5, 664, 018 discloses a watermarking process in which a 
plurality of copies of material items are marked with a digital watermark formed from 
a code word having a predetermined number of coefficients. The watermarked 
material item is for example an image. The apparatus for introducing the watermark 
transforms the image into the Discrete Cosine Transform (DCT) domain. The digital 
watermark is formed from a set of randomly distributed coefficients having a normal 
distribution. In the DCT domain each code word coefficient is added to a 
corresponding one of the DCT coefficients. The watermarked image is formed by 
performing an inverse DCT. A related publication entitled "Resistance of Digital 
Watermarks to Collusion Attacks", by J. Kilian, F. T. Leighton et al, published by 
MJX, July 27, 1 998, provides a detailed mathematical analysis of this watermarking 
process to prove its resistance to attack. 
Summary of Invention 

According to an aspect of the present invention there is provided an encoding 
data processing apparatus for generating at least one marked copy of an original item 
of material by introducing one of a predetermined set of code words into a copy of the 
material item. The code word has a plurality of code word coefficients. The data 
processing apparatus includes an encoding processor operable to combine the code 
word coefficients with the material item. The plurality of code words of the set is 
derived from a first code word comprising a first plurality of coefficients. At least one 
other of the plurality of code words is generated from a cyclic shift of the first code 
word. 
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The present invention aims to provide a practical watermarking system, which 
utilises code words having coefficients which are randomly distributed as proposed as 
in US 5,664,018. In order to implement a practically useful system the number of 
uniquely identifiable code words in the set should be as high as possible. For a 
consumer distributed product such as a video or a film for display at a cinema, there 
should be in the order of a million or preferably tens of millions of -code words in the 
set. As such, it will be appreciated that forming a correlation of each of the 
regenerated code words in the set of ten million and the recovered code word 
represents a considerable computational task. As such even for high performance 
computers, such a correlation would require an impracticably long time or at least an 
inconveniently long time. Embodiments of the present invention are provided with an 
advantage with respect to calculating the correlation values for the code words in the 
set. This is provided by forming at least some of the code words of the set by 
generating a first code word and generating other code words by cyclically shifting the 
first code word. As such the correlation values for all code words of the set can be 
calculated using a Fourier transform correlator. As will be explained, the Fourier 
transform correlator provides the correlation values for the set in one operation, 
substantially reducing the computational task. 

According to an aspect of the present invention there is provided a data 
processing apparatus comprising a decoding processor operable to generate a 
recovered code word from a marked material item, and a detection processor operable 
to detect at least one code word from marked material item. The code word is detected 
from correlation values produced by correlating the recovered code word with each 
one of a plurality of regenerated code words. A code word is detected if the 
corresponding correlation value exceeds a predetermined threshold. The correlation 
value is formed for a plurality of the code words by 

forming a Fourier transform of the recovered code word, 
forming a Fourier transform of the first code word of said set, 
forming the complex conjugate of one of the Fourier transform of the 
recovered code word and the Fourier transform of the regenerated code word, 
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forming intermediate product samples by multiplying -each of said Fourier 
transform samples of said recovered code word and the corresponding Fourier 
transform samples of said first code word, 

forming correlation samples by forming an inverse transform of said 
intermediate product samples, each of said correlation value samples providing the 
correlation value for one of said set of code words. 

In preferred embodiments, the encoding processor is operable to permute the 
order in which the code word coefficients are combined with the material in 
accordance with a permutation code. Correspondingly in preferred embodiments the 
detecting data processor is arranged to reverse the permutation of either the re- 
generated code word coefficients or the recovered code word coefficients in order to 
perform the correlation values. Permuting the code word coefficients provides an 
advantage of reducing the likelihood of a successful collusion attack, which may 
increase by forming the code words from cyclically shifting the first -code word. 

Various further aspects and features of the present invention are defined in the 
appended claims. 
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Description of Preferred Embodiments 
Watermarking System Overview 

An example embodiment of the present invention will now be described with 
reference to protecting video images. The number of users to which the video images 
are to be distributed determines the number of copies. To each copy an identification 
code word is added which identifies the copy assigned to one of the users. 

Video images are one example of material, which can be protected by 
embedding a digital code word. Other examples of material, which can be protected 
by embedding a code word, include software programs, digital documents, music, 
audio signals and any other information-bearing signal. 

An example of an encoding image processing apparatus, which is arranged to 
introduce an identification code word into a copy of an original image, is shown in 
Figure 1. An original image / is received from a source and stored in a frame store t. 
This original image is to be reproduced as a plurality of water marked copies, each of 
which is marked with a uniquely identifiable code word. The original image is passed 
to a Discrete Cosine Transform (DCT) processor 2, which divides the image into 8x8 
pixel blocks and forms a DCT of each of the 8x8 pixel blocks. The DCT processor 2 
therefore forms a DCT transformed image V. 

In the following description the term "samples" will be used to refer to discrete 
samples from which an image (or indeed any other type of material) is comprised. The 
samples may be luminance samples of the image, which is otherwise, produce from the 
image pixels. Therefore, where appropriate the terms samples and pixels are inter- 
changeable. 

The DCT image V is fed to an encoding processor 4. The encoding processor 4 
also receives identification code words from an identification code word -generator 8. 

The code word generator 8 is provided with a plurality of seeds, each seed 
being used to generate one of the corresponding code words. Each of the -generated 
code words may be embedded in a copy of the original image to form a watermarked 
image. The code word generator 8 is provided with a pseudo random number 
generator. The pseudo random number generator produces the code word coefficients 
to form a particular code word. In preferred embodiments the coefficients of the code 
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words are generated in accordance with a normal distribution. However, the 
coefficients of the code word are otherwise predetermined in accordance with the seed, 
which is used to initialise the random number generator. Thus for each code word 
there is a corresponding seed which is store in a data store 12. Therefore it will be 
understood that to generate the code word X i , seedf is retrieved from memory 12 and 
used to initialise the random number generator within the code word generator 8. 

In the following description the DCT version of the original image is 
represented as V, where; 

K = {v,} = {v„v 2 ,v 3 ,v 4 , v w } 

and vj are the DCT coefficients of the image. In other embodiments the 
samples of the image v f - could represent samples of the image in the spatial domain or 
in an alternative domain. 

Each of the code words X* comprises a plurality of n code word coefficients, 

where; 

jr'-fcj-te.*^.*^ *l) 

The number of code word coefficients n corresponds to the number or samples 
of the original image V. However, a different number of coefficients is possible, and 
will be set in dependence upon a particular application. 

A vector of code word coefficients^ forming the f-th code word is then passed 
via channel 14 to the encoder 4. The encoder 4 is arranged to form a watermarked 
image W by adding the code word X* to the image V. Effectively, therefore, as 
represented in the equation below, each of the code word coefficients is added to a 
different one of the coefficients of the image to form the watermark image fK 

W' = V + X' 

JV' = v, +*,',Vj +*2,v 3 +*3>v 4 +Jt 4> v„ +x'„ 

As shown in Figure 1 , the watermarked images W* are formed at the output of 
the image processing apparatus by an forming inverse DCT of the image produced at 
the output of the encoding processor 4 by the inverse DCT processor 1 8. 

Therefore as represented in Figure 1 at the output of the encoder 4 a set of the 
watermarked images can be produced. For a data word of up to 20-bits, one of 10 000 
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000 code words can be selected to generate 10 million watermarked W* versions of the 
original image 

Although the code word provides the facility for uniquely identifying a marked 
copy W* of the image /, in other embodiments the 20 bits can provide a facility for 
communicating data within the image. As will be appreciated therefore, the 20 bits 
used to select the identification code word can provide a 20 bit pay-load for 
communicating data within the image V. 

The encoding image processing apparatus which is arranged to produce the 
watermarked images shown in Figure 1 may be incorporated into a variety of products 
for different scenarios in which embodiments of the present invention find application. 
For example, the encoding image processing apparatus may be connected to a web site 
or web server from which the watermarked images may be downloaded. Before 
downloading a copy of the image, a unique code word is introduced into the 
downloaded image, which can be used to detect the recipient of the downloaded image 
at some later point in time. 

In another application the encoding image processor forms part of a digital 
cinema projector in which the identification code word is added during projection of 
the image at, for example, a cinema. Thus, the code word is arranged to identify the 
projector and the cinema at which the images are being reproduced. Accordingly, the 
identification code word can be identified within a pirate copy produced from the 
images projected by the cinema projector in order to identify the projector and the 
cinema from which pirate copies were produced. Correspondingly, a watermarked 
image may be reproduced as a photograph or printout in which a reproduction or copy 
may be made and distributed. Generally therefore, the distribution of the watermarked 
images produced by the encoding image processing apparatus shown in Figure 1 is 
represented by a distribution cloud 1 9. 
Detecting Processor 

A detecting image processing apparatus which is arranged to detect one or 
more of the code words, which may be present in an offending marked image is shown 
in Figure 2. Generally, the image processor shown in Figure 2 operates to identify one 
or more of the code words, which may be present in an offending copy of the image. 
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The offending version of the watermarked image W is received from a source 
and stored in a frame store 20. Also stored in the frame store 24 is the original version 
of the image /, since the detection process performed by the image processor requires 
the original version of the image. The offending watermarked image W and the 
original version of the image are then fed via respective connecting channels 26, 28 to 
a registration processor 30. 

As already explained, the offending version of the image W may have been 
.produced by photographing or otherwise reproducing a part of the watermarked image 
fK As such, in order to improve the likelihood of detecting the identification -code 
word, the registration processor 30 is arranged to substantially align the offending 
image with the original version of the image present in the data stores 20 and 24. The 
purpose of this alignment is to provide a correspondence between the original image 
samples 1 and the corresponding samples of the watermarked image W* to which the 
code word coefficients have been added. 

The effects of the registration are illustrated in Figure 3. In Figure 3 an 
example of the original image / is shown with respect to an offending marked version 
of the image W. As illustrated in Figure 3, the watermarked image W'\s offset with 
respect to the original image / and this may be due to the relative aspect view of the 
camera from which the offending version of the watermarked image was produced. 

In order to recover a representation of the code word coefficients, the correct 
samples of the original image should be subtracted from the oorresponding samples of 
the marked offending image. To this end, the two images are aligned. As shown in 
Figure 3, the registered image ^"has a peripheral area PA which includes parts which 
were not present in the original image. 

As will be appreciated in other embodiments, the registration processor 30 may 
not be used because the offending image W may be already substantially aligned to 
the originally version of the image 7, such as, for example, if the offending version was 
downloaded via the Internet. Accordingly, the detecting image processor is provided 
with an alternative channel 32, which communicates the marked image directly to the 
recovery processor 40. 
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The registered image Wis received by a recovery processor 40. The recovery 
processor 40 also receives a copy of the original image / via a second channel 44. The 
registered image W" and the original image / are transformed by a DCT transform 
processor 46 into the DCT domain. An estimated code word X' is then formed by 
subtracting the samples of the DCT domain marked image V from the DCT domain 
samples of the original image Fas expressed by the following equations: 

X'= V- V 

= v[ -V,,vJ -V 2 ,VJ -V 3 X - V 4» » V « ~ V n> 

= x[ r x^,x' 3 ,x' t , J m 

The output of the recovery processor 40 therefore provides on a connecting 
channel 50 an estimate of the coefficients of the code word which is to be identified. 
The recovered code word X' is then fed to a first input of a correlator 52. The 
correlator 52 also receives on a second input the regenerated code words X 1 produced 
by the code word generator 54. The code word generator 54 operates in the same way 
as the code word generator 8 which produces all possible code words of the set, using 
the predetermined seeds which identify uniquely the code words from a store 58. 

The correlator 52 forms n similarity sim(f) values. In one embodiment, the 
similarity value is produced by forming a correlation in accordance with following 
equation: 

• /a X '' X ' x;.x j l +x 2 '-x' i +xjx' i + +*„'•*: 

-JX'-X' V*! ■ JC l' + JC 2 "*2+*3 ^ + + X * X 

Each of the n similarity values sim{i) is then fed to a detector 60. The detector 
60 then analyses the similarity values sim{i) produced for each of the n possible code 
words. As an example, the similarity values produced by the correlator 52 are shown 
in Figure 4 with respect to a threshold TH for each of the possible code words. As 
shown in Figure 4, two code words are above the threshold, 2001, 12345. As such, the 
detecting processor concludes that the watermarked version associated with code word 
2001 and code word 12345 must have colluded in order to form the offending image. 
Therefore, in accordance with a false positive detection probability, determined from 
the population size, which in mis case is 10 million and the watermarking strength a , 
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the height of the threshold TH can be set in order to guarantee the false detection 
probability. As in the example in Figure 4, if the similarity values produced by the 
correlator 52 exceed the threshold then, with this false positive probability, the 
recipients of the marked image are considered to have colluded to form the offending 
watermarked version of the image Wi . 

The following sections illustrate advantages and features of the operation of the 
watermarking system illustrated in Figures 1 and 2. 
Registration 

The process of aligning the offending marked version of the image with the 
copy of the original image comprises correlating the samples of the original image 
with respect to the marked image. The correlation is performed for different shifts of 
the respective samples of the images. This is illustrated in Figure 5. 

Figure 5A provides an illustration of discrete samples of the original image /, 
whereas Figure 5B provides an illustration of discrete samples of the offending 
watermarked image W. As illustrated in the Figures 5A and 5B, the sampling rate 
provides a temporal difference between samples of dt. A result of shifting each of the 
sets of samples from the images and correlating the discrete samples is illustrated in 
Figure 5C. 

As shown in Figure 5C, for a shift of between 6 and 7 samples, the correlation 
peak is highest. The offending watermarked image is therefore shifted by this amount 
with respect to the original image to perform registration. 
Fourier Decoding 

As explained, with reference to Figures 1 and 2, the watermarking system can 
provide a facility for generating 10 million watermarked versions of an original image. 
This is effected using a 20-bit watermark value. However, as explained, in order to 
detect the presence of one of the code words in an offending watermarked image, the 
detecting image processor must correlate each of the possible code words in the set of 
10 million code words with respect to a recovered code word from the image. As will 
be appreciated, this represents a considerable computational task. 
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A correlator embodying the present invention provides a significant advantage 
in reducing the computational effort and therefore the time taken to detect the presence 
of a code word in an offending watermarked image. A correlator in accordance with 
the embodiment of the present invention is illustrated in Figure 6. The correlator 
shown in Figure 6 takes advantage of an alternative technique for calculating the 
correlation sum shown above. In accordance with this technique the correlation sum is 
calculated in accordance with the following equation: 

F - ' [F{X ')/■-( A" £0 ) 4 J, where F{A) is the Fourier transform of A and F~\{A)\s 
the inverse Fourier transform of A. 

The correlator 52 shown in Figure 6 therefore comprises a first Fourier 
transform processor 100, and a second Fourier transform processor 102. Fourier 
transform processors 100, 102 may be implemented using Fast Fourier transform 
algorithms. The second Fourier transform processor 102 also forms the complex 
conjugate of the Fourier transform of the regenerated code word XK The Fourier 
transform of the recovered code word X' and the complex conjugate of the Fourier 
transform of the regenerated code word X i are fed to first and seconds inputs of a 
multiplier 110. The multiplier 110 multiplies the respective samples from each of the 
Fourier transform processors 100, 102 and feeds the multiplied samples to an inverse 
Fourier transform processor 112. At the output of the correlator an inverse Fourier 
transform of the multiplied signals samples is formed. 

As will be appreciated, the implementation of the correlator 52 shown in Figure 
6 provides an advantage in terms of time taken to compute the correlation for the n 
sample values of the regenerated code word X 1 and the recovered code word X'. This 
is because the Fourier processors 100, 102, 112 can be formed from FFT integrated 
circuits such as, for example, are available as ASICS. Furthermore, the inverse Fourier 
transform provided at the output of the correlator 52 provides n similarity values simfij 
corresponding to n correlation sums. However, in order to utilise the properties of the 
correlator 52, shown in Figure 6 the code words aTe arranged to be generated by 
cyclically shifting one code word generated X(0 using a particular seed for the random 
number generator. This is illustrated below. As shown below, the first code word X {1) 
is represented as values x t to jc„ which corresponds to the pseudo randomly produced 
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numbers from the code word generator 8. However, the second -code word X (2) is 
produced by performing a cyclic shift on the first code word X™ . Correspondingly, 
each of the other code words are produced by correspondingly cyclically shifting 
further the code word X m until the w-th code word is a code word shifted by w-1 
positions. 

X {1) -+(x t ,x 2 ,x 3 ,x t »*.-n*J 

X (2) ->(x 2 ,x 3 ,x A 

X (3) -+(x 3 ,x 4 .^.j.x^jc,,^) 



X {n) ->• (x„ , x x , x 2 , x 3 , x 4 , jc„_ 2 , x„_, ) 

By using this set of code words to form part of, or the whole of, the set of code 
words produced by the encoding image processor, the Fourier transform correlator 52 
can be used to generate in one operation all similarity values for all of the n code 
words. Therefore, as illustrated above, the corresponding shift of 1 to n of the original 
code word provides the n similarity values simft), and as illustrated in Figure 4, for at 
least one of the code words, a large similarity value sim(i) is produced. Therefore, as 
will be appreciated the correlator 52 only receives one regenerated code word 
corresponding to first code word X m to form the similarity values for the set of n code 
words as illustrated in Figure 4. 

As will be appreciated from the above explanation, if the code word contains N 
samples, then only N unique cyclic shifts are possible. Therefore, if the required 
population of code words is p, which is greater than N, then several base watermarks 
will be required. Each base watermark can be cyclically shifted to produce N unique 
code words. 

If the watermarked image forms one of a plurality of images in, for example, a 
video sequence, then the same code word will be added to each of the images. As 
such, once the suspected code word has been identified using the Fourier transform 
corrolator illustrated in Figure 6, then a subsequent correlation can be formed using the 
full correlation sum simft) as explained above. However, because the suspected code 
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word has already been identified, then the correlation only needs to be performed once 
for the code word identified by the Fourier transform correlator shown in Figure 6. 

As will be appreciated, instead of forming the conjugate of the Fourier 
transform of the regenerated first code word X\ the conjugate of the Fourier 
transform of the recovered code word could be formed. This is expressed by the 
second alternative of the Fourier transform correlator shown below: 

F- x [F(Xy F{X m )] 

Accordingly the conjugate of one of the Fourier transform of the recovered 
code word and the Fourier transform of the regenerated code word is formed by the 
Fourier transform processors 100, 102. 
Secret Permutation of Code Words 

One disadvantage of forming a code word from a cyclic shift of a first code 
word X x is that the security of the watermark may be compromised. This is because 
under a collusion attack two watermarked images are compared. If the same code 
word has been added to each image, with only a cyclic shift with respect to two 
versions of the same code word, an attacker may be more likely to identify the 
differences between the two marked material items and therefore identify the code 
word. With knowledge of the code word an attacker may either remove the watermark 
or alter the watermark to falsely implicate another. 

In order to reduce the likelihood of a successful collusion attack, the order of 
each of the code word coefficients of each of the cyclically shifted code words is 
randomly permuted in accordance with a secret permutation code n. The permutation 
of the code word coefficients remains secret from the recipients of the marked images. 
Accordingly the likelihood of a successful collusion attack is reduced by an increase in 
the difficulty presented to a collusion attacker of identifying a correlation between two 
marked images. 

At the detecting data processor the secret permutation code ic will be known. 
In the detecting data processor, either the code word re-generator or the recovery 
processor 40 is operable to reverse the permutation tr 1 of either the re-generated code 
word coefficients or the recovered code word coefficients in order to perform the 
correlation. The operation of the encoding data processor of Figure I and the detecting 



(37) 



JP 2004-40754 A 2004. Z. "5 



data processor of Figure 2 is therefore as presented in a flow diagrams in Figures 7 and 

8 respectively. 

Code Word Generation 

A further advantageous aspect of the embodiment shown in Figures 1 and 2 is 
provided by generating the seed of the random number from which the code word is 
produced from the source image samples. This is affected by analysing the DCT 
coefficients of the image to be watermarked and from these coefficients, generating the 
seed to be used to generate the code word. This can be effected, for example, by using 
a hashing algorithm known to those skilled in the art as "secure hashing algorithm 1" 
(sha-1). This algorithm forms an ANSI standard (ANSI x9.30-2). This algorithm is 
referred to in a book entitled "Handbook of applied cryptography" by A.J. Menezes. 
As such the seed from the random number can be generated and determined in the 
encoding image processor and the detecting image processor from the DCT 
coefficients. 
Other Applications 

In addition to the above-mentioned applications of the encoding data 
processing apparatus of the watermarking system to a cinema projector and to a web 
server, other applications are envisaged. For example, a receiver/decoder is envisaged 
in which received signals are watermarked by introducing code words upon receipt of 
the signals from a communicating device. For example, a set top box is typically 
arranged to receive television and video signals from a "head-end" broadcast or multi- 
cast device. As will be appreciated in this application, the encoding data processing 
apparatus forms part of the set top box and is arranged to introduce watermark code 
words into the video signals as the signals are received and decoded. In one example 
embodiment, the watermark code word is arranged to uniquely identify the set top box 
which receives and decodes the video signals. 

In a further embodiment a digital cinema receiver is arranged to receive a 
digital cinema film via a satellite. The receiver is arranged to receive signals 
representing the digital cinema film and to decode the signals for reproduction. The 
receiver includes an encoding data processing apparatus, which introduces a 
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watermark code word into the decoded film signals. The watermark code word is 
provided, for example, to uniquely identify the cinema receiving the film signals. 

A further example embodiment may comprise a digital camera or camcorder or 
the like which includes a memory and a memory controller. An encoding data 
processing apparatus according to an embodiment of the present invention is arranged 
to introduce a watermark code word stored in the memory into video signals captured 
by the camera. According to this embodiment, the encoding data processing apparatus 
does not include a code word generator because the code word is pre-stored in the 
memory. Under the control of the memory controller the code word stored in the 
memory is embedded into the video signals, uniquely or quasi-uniquely identifying the 
video signals. 

In a further embodiment, an encoding data processing apparatus according to 
an embodiment of the invention is operable encoded a sequence of watermark code 
words into different frames of digital images forming a continuous or moving picture. 
The code words may be related to one another and may be used to identify each of the 
images separately. 

Various further aspects and features of the present invention arc defined in the 
appended claims. Various modifications can be made to the embodiments herein 
before described without departing from the scope of the present invention. 
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4 Brief Description of Drawings 

Figure 1 is a schematic block diagram of an encoding image processing 
apparatus; 

Figure 2 is a schematic block diagram of a detecting image processing 
apparatus; 

Figure 3 A is a representation of an original image, Figure 3B is a 
representation of a marked image and Figure 3C is the marked image after registration; 

Figure 4 is a graphical representation of an example correlation result for each 
of a set of N code words; 

Figure 5 A is a graphical representation of samples of the original image /, 
Figure 5B is a graphical representation of samples of the watermarked image W; 
Figure 5C is a graphical representation of correlation results for the original image and 
the watermarked image with respect to discrete sample shifts; 

Figure 6 is a schematic block diagram of a correlator forming part of the 
detecting data processing apparatus shown in Figure 2; 

Figure 7 is a flow diagram of a process for forming watermarked images 
performed by the encoding image data processor, and 

Figure 8 is a flow diagram of a process for identifying a watermark from a 
received marked copy of the image performed by the detecting data processor of 
Figure 2; 
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1 Abstract 

A watermarking system comprises an encoding data processor operable to 
generate at least one marked version of an original item of material by introducing one 
of a predetermined set of code words into a copy of the original material item. The 
apparatus comprises a code word generator operable to provide the code word 
comprising a plurality of code word coefficients, and an encoding processor operable 
to combine the code word coefficients with the material. The set of code words is 
formed by cyclically shifting a first code word. An advantage is thereby provided to a 
detecting data processor, which can be arranged to form the correlation values for all 
code words, formed by shifting the first code word, using a Fourier transform 
correlator. As a result a time taken to detect a code word present in a marked material 
item can be considerably improved. The watermarking system finds particular 
application in identifying a point of distribution of pirate copies of video material 
generated by capturing the watermarked image, using, for example, a camcorder in a 
cinema. 

2 Representative Drawing 

[Fig 7] 
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